Merged
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076302
Total [baseline] (10.392 s) : 0, 10391642
Agent [candidate] (1.083 s) : 0, 1083349
Total [candidate] (10.415 s) : 0, 10414913
section appsec
Agent [baseline] (1.189 s) : 0, 1188651
Total [baseline] (10.502 s) : 0, 10502145
Agent [candidate] (1.197 s) : 0, 1197083
Total [candidate] (10.448 s) : 0, 10447719
section iast
Agent [baseline] (1.207 s) : 0, 1207231
Total [baseline] (10.703 s) : 0, 10703360
Agent [candidate] (1.205 s) : 0, 1204863
Total [candidate] (10.736 s) : 0, 10736433
section profiling
Agent [baseline] (1.267 s) : 0, 1267012
Total [baseline] (10.545 s) : 0, 10545125
Agent [candidate] (1.266 s) : 0, 1265578
Total [candidate] (10.596 s) : 0, 10595682
gantt
title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.058 ms) : 0, 674058
BytebuddyAgent [candidate] (678.953 ms) : 0, 678953
GlobalTracer [baseline] (310.004 ms) : 0, 310004
GlobalTracer [candidate] (311.849 ms) : 0, 311849
AppSec [baseline] (49.42 ms) : 0, 49420
AppSec [candidate] (49.749 ms) : 0, 49749
Remote Config [baseline] (660.848 µs) : 0, 661
Remote Config [candidate] (654.629 µs) : 0, 655
Telemetry [baseline] (7.632 ms) : 0, 7632
Telemetry [candidate] (7.538 ms) : 0, 7538
section appsec
BytebuddyAgent [baseline] (695.543 ms) : 0, 695543
BytebuddyAgent [candidate] (700.535 ms) : 0, 700535
GlobalTracer [baseline] (291.192 ms) : 0, 291192
GlobalTracer [candidate] (293.405 ms) : 0, 293405
AppSec [baseline] (149.085 ms) : 0, 149085
AppSec [candidate] (149.69 ms) : 0, 149690
Remote Config [baseline] (621.77 µs) : 0, 622
Remote Config [candidate] (630.107 µs) : 0, 630
Telemetry [baseline] (8.139 ms) : 0, 8139
Telemetry [candidate] (8.521 ms) : 0, 8521
IAST [baseline] (19.18 ms) : 0, 19180
IAST [candidate] (19.318 ms) : 0, 19318
section iast
BytebuddyAgent [baseline] (800.472 ms) : 0, 800472
BytebuddyAgent [candidate] (798.979 ms) : 0, 798979
GlobalTracer [baseline] (289.617 ms) : 0, 289617
GlobalTracer [candidate] (288.578 ms) : 0, 288578
AppSec [baseline] (52.774 ms) : 0, 52774
AppSec [candidate] (49.421 ms) : 0, 49421
Remote Config [baseline] (753.143 µs) : 0, 753
Remote Config [candidate] (2.1 ms) : 0, 2100
Telemetry [baseline] (6.658 ms) : 0, 6658
Telemetry [candidate] (6.711 ms) : 0, 6711
IAST [baseline] (22.382 ms) : 0, 22382
IAST [candidate] (24.595 ms) : 0, 24595
section profiling
ProfilingAgent [baseline] (95.782 ms) : 0, 95782
ProfilingAgent [candidate] (95.264 ms) : 0, 95264
BytebuddyAgent [baseline] (676.922 ms) : 0, 676922
BytebuddyAgent [candidate] (676.522 ms) : 0, 676522
GlobalTracer [baseline] (379.455 ms) : 0, 379455
GlobalTracer [candidate] (379.382 ms) : 0, 379382
AppSec [baseline] (50.326 ms) : 0, 50326
AppSec [candidate] (50.059 ms) : 0, 50059
Remote Config [baseline] (712.761 µs) : 0, 713
Remote Config [candidate] (713.518 µs) : 0, 714
Telemetry [baseline] (7.497 ms) : 0, 7497
Telemetry [candidate] (7.485 ms) : 0, 7485
Profiling [baseline] (95.806 ms) : 0, 95806
Profiling [candidate] (95.287 ms) : 0, 95287
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.075 s) : 0, 1074895
Total [baseline] (8.53 s) : 0, 8529612
Agent [candidate] (1.074 s) : 0, 1074094
Total [candidate] (8.527 s) : 0, 8527395
section iast
Agent [baseline] (1.205 s) : 0, 1205309
Total [baseline] (8.999 s) : 0, 8998667
Agent [candidate] (1.206 s) : 0, 1206374
Total [candidate] (9.036 s) : 0, 9035605
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.215 s) : 0, 1215259
Total [baseline] (9.01 s) : 0, 9010254
Agent [candidate] (1.2 s) : 0, 1199505
Total [candidate] (8.969 s) : 0, 8968629
section iast_TELEMETRY_OFF
Agent [baseline] (1.193 s) : 0, 1193190
Total [baseline] (8.985 s) : 0, 8984892
Agent [candidate] (1.198 s) : 0, 1198494
Total [candidate] (8.996 s) : 0, 8996385
gantt
title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.109 ms) : 0, 674109
BytebuddyAgent [candidate] (673.062 ms) : 0, 673062
GlobalTracer [baseline] (308.885 ms) : 0, 308885
GlobalTracer [candidate] (309.304 ms) : 0, 309304
AppSec [baseline] (49.272 ms) : 0, 49272
AppSec [candidate] (49.093 ms) : 0, 49093
Remote Config [baseline] (658.237 µs) : 0, 658
Remote Config [candidate] (664.537 µs) : 0, 665
Telemetry [baseline] (7.574 ms) : 0, 7574
Telemetry [candidate] (7.648 ms) : 0, 7648
section iast
BytebuddyAgent [baseline] (798.751 ms) : 0, 798751
BytebuddyAgent [candidate] (798.658 ms) : 0, 798658
GlobalTracer [baseline] (289.26 ms) : 0, 289260
GlobalTracer [candidate] (289.871 ms) : 0, 289871
AppSec [baseline] (52.09 ms) : 0, 52090
AppSec [candidate] (49.875 ms) : 0, 49875
IAST [baseline] (23.368 ms) : 0, 23368
IAST [candidate] (25.397 ms) : 0, 25397
Remote Config [baseline] (650.372 µs) : 0, 650
Remote Config [candidate] (657.496 µs) : 0, 657
Telemetry [baseline] (6.672 ms) : 0, 6672
Telemetry [candidate] (7.35 ms) : 0, 7350
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (805.931 ms) : 0, 805931
BytebuddyAgent [candidate] (793.79 ms) : 0, 793790
GlobalTracer [baseline] (291.425 ms) : 0, 291425
GlobalTracer [candidate] (288.491 ms) : 0, 288491
AppSec [baseline] (52.734 ms) : 0, 52734
AppSec [candidate] (51.928 ms) : 0, 51928
IAST [baseline] (22.856 ms) : 0, 22856
IAST [candidate] (23.533 ms) : 0, 23533
Remote Config [baseline] (661.745 µs) : 0, 662
Remote Config [candidate] (657.294 µs) : 0, 657
Telemetry [baseline] (6.802 ms) : 0, 6802
Telemetry [candidate] (6.681 ms) : 0, 6681
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (789.681 ms) : 0, 789681
BytebuddyAgent [candidate] (792.945 ms) : 0, 792945
GlobalTracer [baseline] (287.088 ms) : 0, 287088
GlobalTracer [candidate] (288.362 ms) : 0, 288362
AppSec [baseline] (48.965 ms) : 0, 48965
AppSec [candidate] (47.883 ms) : 0, 47883
IAST [baseline] (26.023 ms) : 0, 26023
IAST [candidate] (24.707 ms) : 0, 24707
Remote Config [baseline] (580.242 µs) : 0, 580
Remote Config [candidate] (589.204 µs) : 0, 589
Telemetry [baseline] (6.585 ms) : 0, 6585
Telemetry [candidate] (9.566 ms) : 0, 9566
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section baseline
no_agent (1.36 ms) : 1341, 1379
. : milestone, 1360,
appsec (1.73 ms) : 1705, 1754
. : milestone, 1730,
appsec_no_iast (1.701 ms) : 1676, 1725
. : milestone, 1701,
iast (1.498 ms) : 1475, 1521
. : milestone, 1498,
profiling (1.508 ms) : 1483, 1532
. : milestone, 1508,
tracing (1.486 ms) : 1462, 1510
. : milestone, 1486,
section candidate
no_agent (1.357 ms) : 1338, 1377
. : milestone, 1357,
appsec (1.735 ms) : 1711, 1760
. : milestone, 1735,
appsec_no_iast (1.746 ms) : 1722, 1770
. : milestone, 1746,
iast (1.485 ms) : 1463, 1508
. : milestone, 1485,
profiling (1.506 ms) : 1481, 1531
. : milestone, 1506,
tracing (1.477 ms) : 1452, 1501
. : milestone, 1477,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section baseline
no_agent (368.706 µs) : 349, 389
. : milestone, 369,
iast (479.673 µs) : 459, 501
. : milestone, 480,
iast_FULL (547.548 µs) : 526, 569
. : milestone, 548,
iast_GLOBAL (508.164 µs) : 486, 530
. : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (479.241 µs) : 458, 501
. : milestone, 479,
iast_INACTIVE (451.078 µs) : 430, 472
. : milestone, 451,
iast_TELEMETRY_OFF (469.241 µs) : 448, 490
. : milestone, 469,
tracing (443.687 µs) : 423, 464
. : milestone, 444,
section candidate
no_agent (376.009 µs) : 356, 396
. : milestone, 376,
iast (481.315 µs) : 461, 502
. : milestone, 481,
iast_FULL (541.665 µs) : 520, 563
. : milestone, 542,
iast_GLOBAL (497.753 µs) : 477, 518
. : milestone, 498,
iast_HARDCODED_SECRET_DISABLED (476.016 µs) : 455, 497
. : milestone, 476,
iast_INACTIVE (451.214 µs) : 431, 472
. : milestone, 451,
iast_TELEMETRY_OFF (473.1 µs) : 452, 494
. : milestone, 473,
tracing (443.77 µs) : 424, 464
. : milestone, 444,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section baseline
no_agent (1.464 ms) : 1452, 1475
. : milestone, 1464,
appsec (2.212 ms) : 2178, 2246
. : milestone, 2212,
iast (1.904 ms) : 1868, 1940
. : milestone, 1904,
iast_GLOBAL (1.927 ms) : 1891, 1964
. : milestone, 1927,
profiling (1.857 ms) : 1823, 1891
. : milestone, 1857,
tracing (1.844 ms) : 1811, 1876
. : milestone, 1844,
section candidate
no_agent (1.467 ms) : 1454, 1479
. : milestone, 1467,
appsec (2.213 ms) : 2179, 2247
. : milestone, 2213,
iast (1.885 ms) : 1850, 1920
. : milestone, 1885,
iast_GLOBAL (1.921 ms) : 1885, 1956
. : milestone, 1921,
profiling (1.851 ms) : 1819, 1884
. : milestone, 1851,
tracing (1.845 ms) : 1813, 1877
. : milestone, 1845,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~7a9abad785, baseline=1.34.0-SNAPSHOT~6bb68c469d
dateFormat X
axisFormat %s
section baseline
no_agent (14.954 s) : 14954000, 14954000
. : milestone, 14954000,
appsec (15.293 s) : 15293000, 15293000
. : milestone, 15293000,
iast (18.901 s) : 18901000, 18901000
. : milestone, 18901000,
iast_GLOBAL (17.797 s) : 17797000, 17797000
. : milestone, 17797000,
profiling (14.903 s) : 14903000, 14903000
. : milestone, 14903000,
tracing (15.31 s) : 15310000, 15310000
. : milestone, 15310000,
section candidate
no_agent (14.779 s) : 14779000, 14779000
. : milestone, 14779000,
appsec (15.206 s) : 15206000, 15206000
. : milestone, 15206000,
iast (18.944 s) : 18944000, 18944000
. : milestone, 18944000,
iast_GLOBAL (17.982 s) : 17982000, 17982000
. : milestone, 17982000,
profiling (15.135 s) : 15135000, 15135000
. : milestone, 15135000,
tracing (14.872 s) : 14872000, 14872000
. : milestone, 14872000,
|
mcculls
approved these changes
Apr 29, 2024
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR fix few test names to not rely on toString() for generated names, making them unique across runs.
Motivation
This will help identify tests in CI visibility.
Additional Notes
Jira ticket: [PROJ-IDENT]